ALTERNATING, PATTERN- AVOIDING PERMUTATIONS 

JOEL BREWSTER LEWIS 

Abstract. Wc study the problem of counting alternating permutations avoiding 
collections of permutation patterns including 132. We construct a bijection between 
the set iS n (132) of 132-avoiding permutations and the set j42 ra +i(132) of alternating, 
132-avoiding permutations. For every set pi, . . . ,pk of patterns and certain related 
patterns qi, . . . , q k , our bijection restricts to a bijection between S n (132,pi, . . . ,Pk), 
the set of permutations avoiding 132 and the pi, and A2„+i(132, qi, . . . , q k ), the set 
of alternating permutations avoiding 132 and the qi. This reduces the enumeration of 
the latter set to that of the former. 



1. Introduction 

A classical problem asks for the number of permutations that avoid a certain per- 
mutation pattern. This problem has received a great deal of attention (e.g., [H [3]) 
and has led to a number of interesting variations including the enumeration of permu- 
tations avoiding several patterns simultaneously [U [7] and the enumeration of special 
classes of pattern-avoiding permutations (e.g., involutions [21 E] and derangements [6]). 
In this paper we consider a variation on this problem first studied by Mansour in [5], 
namely the enumeration of alternating permutations avoiding certain patterns. Sec- 
tion [2] provides definitions and some background. In Section [3] we construct a bijection 
tp : S' n (132) — > v4 2n+1 (132) that preserves pattern information and so allows us to relate 
many instances of our problem to the classical problem. In particular, it provides a 
bijection between S' n (132,p 1 , . . . ,p k ) and J 4 2n+ i(132, q 1 , . . . , q k ) for every set of patterns 
Px, ■ ■ ■ ,Pk and certain related patterns qx, . . . , q k - This reduces the enumeration of many 
classes of alternating, pattern-avoiding permutations to similar but simpler problems 
involving all permutations. We give a few explicit examples, one of which (Corollary 
14. 2p are already known by recursive, generating functional methods [5j; we believe the 
others to be original. 



2. Background and Definitions 

A permutation w = Wxw^ ■ • ■ w n of length n is a sequence containing each of the 
integers 1 through n exactly once. A permutation is alternating if wx < W2 > < > 
. . .. (Note that in the terminology of |8J, these "up-down" permutations are reverse 
alternating while alternating permutations are "down-up" permutations, but that any 
result on either set can be translated into a result on the other via complementation, 
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i.e. by considering w' such that w\ — n + 1 — Wi, so the pattern 132 would be replaced 
by 312 and so on.) 

Given a permutation p G S k and a sequence u; = W\ ■ ■ -w n , we say that w contains 
the pattern p if there exists a set of indices 1 < %\ < z 2 < . . . < i k < n such that 
the subsequence w^w^ ■ ■ ■ Wi k of w is order-isomorphic to p, i.e. the relative order of 
elements in the two sequences is the same. Otherwise, w is said to avoid p. Given 
patterns Pi, ■ ■ ■ ,Pk, we denote by S n (pi, . . . ,p k ) the set of permutations of length n 
avoiding all of the Pi and by A n {pi, . . . ,p k ) the set of alternating permutations of length 
n avoiding all of the p h and we set s n (jp 1} ...,p k ) = \S n {p^ ...,p k ) \ and a n (p u ...,p k ) = 
\A n (p u . . .,p k )\- 

The set S n+ i(132) can be easily enumerated, as follows: if w G S , n+ i(132), w k+ i = n+ 
1 and 1 < % < k+1 < j < n+1 then Wi > Wj or else WiW k+ iWj is a 132-pattern contained 
in w. Thus, {wi, . . . , w k } = {n - k + 1, . . . , n}, {w k+2 , ■ ■ ■, w n+ i} = {l,...,n — k} and 
the sequences W\ • • • w k , w k+ 2 • ■ ■ w n are themselves 132-avoiding. Conversely, it's easy 
to check that if for some k the permutation w' = w[ - ■ ■ w' n+l is such that w' k+1 — n + 1, 
{ w ' k +2i • • • ? w 'n+i} — {!)■■■! n — k}, {w[, . . . , w' k } = {n — k + 1, . . . , n} and the sequences 
w[ ■ ■ -w' k , w' k+2 ■ ■ -w' n+1 are 132-avoiding then w' E S' n+ i(132). It follows immediately 
that 

n 

(132) = ^s fc (132) -s n _ fc (132) 

fc=0 

with initial value So(132) = 1, so s n (132) is equal to the nth Catalan number C n = 

1 /2n\ 
n+1 U/' 

A nearly identical argument can be applied to a2„+i(132) - one need only note that 
the position of the maximal element 2n + 3 in a permutation w G A2n+3(132) must be 
even, so 

n 

a 2ri+3 (132) = ^a 2 fe+i(132) • a 2n _2fe+i(132) 

fc=0 

with ai(132) = 1 and thus a 2n+ i(132) = C n and a 2n+ i(132) = s n (132). In the next 
section, we provide a bijective proof of this result. 

3. Key bijection 

Given any permutation w 6 5„, we can bijectively associate a labeled, decreasing 
binary tree T(w) as in Chapter 1 of (SJ: if w k is the maximal entry of w, we label the 
root with w k , let the left subtree below the root be T{uii ■ ■■w k ^i) and let the right 
subtree be T(w k+ i ■ ■ -w n ). Note that for any i G [n], the vertex labeled Wi has a left 
child in T(w) if and only if i > 1 and Wi > Wi-i and has a right child if and only if 
i < n and Wi > Wi + \. In particular, T(w) is complete (i.e. every vertex has either zero 
or two children) if and only if w is an alternating permutation of odd length. 
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Figure 1. Applying ip to 2341 gives 675849231. The subsequence 7893 
of even-indexed entries is order-isomorphic to 2341. 

If w is 132-avoiding then for any vertex v in T(w), each label on the left subtree at v 
is larger than every label on the right subtree at v. (This is essentially the same obser- 
vation that we used to derive our recursion for s n (132) above.) Erasing all labels gives 
a bijection between decreasing, labeled binary trees with this property and unlabeled 
binary trees and we will consider this bijection to be an identification, i.e. we will treat 
unlabeled trees and trees labeled in this way as interchangeable. 

For any unlabeled binary tree T we may construct the completion C(T) by adding 
vertices to T so that every vertex of T has two children in C(T) and every vertex of 
C(T) that is not also a vertex of T has zero children in C(T). This operation is a 
bijection between unlabeled binary trees on n nodes and unlabeled complete binary 
trees on 2n + 1 nodes; to reverse it, erase all leaves. 

We can use these three operations to construct a bijection between S n (132) and 
^2n+i(132): beginning with any permutation w G 5^(132), construct the labeled tree 
T(w). Erase the labels from this tree and take its completion. Take the associated 
labeled tree and apply the inverse of the bijection T. The resulting permutation is an 
alternating, 132-avoiding permutation of length 2n + 1, i.e. an element of J 42„+i(132). 
Each step is bijective, so the composition of steps is bijective. We denote this bijec- 
tion by if : S' n (132) — > A2 n+ i(132). Figure [1] illustrates the application of tp to the 
permutation 2341. 

Note that ip~ l has a particularly nice form: erasing the leaves of T(ip(w)) is the 
same as erasing the odd-indexed entries in ip(w), so w is just the permutation order- 
isomorphic to the sequence ((p(w)2, ip{w)^ .. .) and (f(w) is the unique member of 
A 2n+ i(132) whose sequence of even-indexed entries is order-isomorphic to w. It fol- 
lows immediately that if w contains a pattern p then tp(w) does as well. In fact, we can 
say substantially more: 

Proposition 3.1. If a permutation w G S' n (132) contains the pattern p G iSfc(132) then 
<p(w) G y42n+i(132) contains ip(p) G A 2 fc+i(132). 

Note that the restriction p G Sfc(132) is actually no restriction at all: pattern con- 
tainment is transitive, so if w avoids 132 then w automatically avoids all patterns that 
contain 132. 
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Proof. Suppose w contains p. Choose a sequence 1 < i\ < i 2 < . . . < if. < n such 
that Wi x Wi^ ■ ■ -Wi k is an instance of p contained in w. Note that each vertex of T(w) 
corresponds naturally via our construction to a vertex of T(ip(w)), and similarly for 
T{p) and T(ip{p)). For each j, denote by Vj the vertex of T(^p(w)) corresponding to the 
vertex labeled in T{w) and denote by v'j the vertex of T(ip{p)) corresponding to the 
vertex labeled pj in T(p). 

We build a set of 2k + 1 vertices of T(ip(w)) as follows: first, we include the vertices 
Vj for 1 < j < k. Then, for each j, we add the left child of Vj to our set if and only if v'j 
has a left child in T(ip(p)) but the vertex labeled pj in T(p) does not - that is, take the 
left child of Vj if and only if a new left child was added to the vertex labeled pj when 
passing from T(p) to T{ip{p)). Do the same for right children. Figure [3] illustrates this 
process for p = 4312 and w = 5647231. 

The relative order on the labels of vertices in this collection is determined entirely 
by the relative position of these vertices in the treej^ and the relative positions of these 
vertices in T(ip{w)) are the same as their relative positions in T(ip(p)). Thus the labels 
on these vertices form a ^(jo)-pattern contained in ip(w). □ 

The converse of this result is also true, and we prove a modest strengthening of it. 

Proposition 3.2. Suppose tp{w) G A2„+i(132) contains a pattern q and q contains p, 
with the additional restriction that there is some subsequence of q order-is omorphic to 
p that contains no left-to-right minima of q. Then w G <5'„(132) contains p. 

Proof. If (f(w) 2 k-i < ^{w)2k+\ then ip(w) 2 k-i < (f(w) 2 k+i < ( p(w) 2 k is a 132-pattern 
contained in tf(w), a contradiction, so <p{w)\ > v 2 (^)3 > V 9 ( u ')5 > • • • and the left-to- 
right minima of p(w) are exactly the odd-indexed entries. Select an instance of q in (p(w) 
and choose the special subsequence corresponding to p. No entry of this subsequence 
is a left-to-right minimum in our instance of q, so no entry of this subsequence is a 
left-to-right minimum in tp(w). Then every entry of this subsequence (an instance of 
the pattern p) occurs among the even- indexed entries of f(w). Since the sequence of 
even-indexed entries is order-isomorphic to w, p is contained in w. □ 

The converse of Proposition 13.11 follows because the even-indexed entries of <p(p) are 
an instance of p including no left-to-right minima in tp(p), so if tp(w) contains tp(p) then 
w contains p. 

4. Consequences 
We can rephrase the results of the previous section as follows: 

1 By the "relative position" of vertices a and 6, we mean the following: either one of a and b is a 
descendant of the other, in which case the ancestor has the larger label, or they have some nearest 
common ancestor c. In the latter case, we say a is "relatively to the left" of b if a lies in the left subtree 
of c and b lies in the right subtree of c. By the 132-avoidance of the permutations associated to these 
trees, "being relatively left" implies "having a larger label." 



ALTERNATING, PATTERN-AVOIDING PERMUTATIONS 5 

w = 5647231 p = 4312 w contains p, 

so apply T 




and complete the trees. 



Figure 2. The subsequence 6423 of w = 5647231 is an instance of p = 
4312. We apply T and complete both trees. For each (circled) node 
of C(T{w)) corresponding to a node of T(jp) we select (box) a child if 
and only if the corresponding child was added to T(p) in the completion 
C(T(p)). The resulting subsequence 1314910 5 64 73 is an instance of 
<p(p) = 896734251 in <p(w) = 12 13 11 14 9 10 8 15 5 6 4 7 2 3 1. 

Theorem 4.1. For any collection of 132-avoiding patterns pi, ■ ■ ■ ,Pk, choose patterns 
qi, . . . , qk such that qi is contained in p(pi) and there is an instance ofpi contained in qi 
containing no left-to-right minima ofqi. Then tp is a bisection between S n (132,pi, . . . ,pk) 
and v4 2n+ i(132, q 1 , . . . , q k ), and in particular these sets are equinumerous. 

Note that (p(pi) is always a valid choice for q^ but that there may also be others. Also, 
because ip is a bijection on classes of pattern-avoiding permutations and on their com- 
plements, this restatement does not actually capture the full strength of our previous 
results. 

Proof. We have by Proposition ^. ll that the image of S n (132, pi, . . . , p k ) under <p contains 
^-2n+i(132, ip(pi), • • • , <p(pk)) while we have by Proposition l3.2l that (p is an injection from 
S' n (132,pi, . . . ,pk) to y4 2n+ i(132, gi, . . . , qk)- By transitivity of pattern containment, 
A 2n+ i(132, ip{pi), . . . , <p(pk)) 2 A 2n +i{132,q 1 , . . . ,q k ). Thus in fact ip is a bijection 
between S' n (132,pi ! . . . ,pk) and A 2ri+ i(132, gi, . . . , q^), as claimed. □ 

As a result of this theorem, a large class of enumeration problems for pattern-avoiding 
alternating permutations can be expressed as enumeration problems for pattern-avoiding 
(standard) permutations. We give three examples involving a single pattern. 
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Corollary 4.2. For all n > 0, k > 1, s„(132, 12 • • • jfe) = a 2n+ i(132, 12 • • • (k + 1)). 
^45 a result, w G <S , n (132) /ias longest increasing subsequence of length k if and only if 
<p(w) € A 2n+ i(132) has longest increasing subsequence of length k + 1. 

Proof. We have that ip(12 ■ • • k) = k(k + l)(k - l)(k + 2) (Jfe - 2) • ■■2(2k + 1)1 contains 
the subsequence kik + l)(k + 2) ■ • • (2k){2k + 1). This is an instance of the pattern 
q = 12 • • ■ fc(/fe + 1) and q contains an instance of 12 • • • k not including any left-to-right 
minima of q, so tp is a bijection between 5^(132, 12 - • • k) and A 2n+ i(132, 12 ■ • ■ k(k + l)), 
the first half of the claim. 

For the second half, note that the set of permutations in S' n (132) with longest increas- 
ing subsequence of length k is S := S n (132, 12 • • • k(k + 1)) \ S n (132, 12 • • • k). Since 
A 2n+1 (132, 12 • • • (k + 1)) C A 2n+1 (132, 12 • • • (k + l)(k + 2)) and 5„(132, 12 • • • k) C 
S n (132, 12 • • • k{k + l)), if is a bijection between S and A 2n+1 (132, 12 • • • (A; + 1) (A; + 2)) \ 
A 2n+ i(132, 12 • • • (k + 1)), the set of 132-avoiding alternating permutations with longest 
increasing subsequence of length k + 1. □ 

For k = 1 the resulting sequence is a 2n+ i(132, 123) = s„(132, 12) = 1. For k = 2 it's 
a 2n+ i (132, 1234) = s n (132, 123) = \2 n ~ 1 ^ (see jZJ). For fc = 3 it's the even Fibonacci 
sequence a 2n+ i (132, 12345) = s„(132, 1234) = F 2n _ 2 defined with initial terms F = 
Fi — 1 (see [9]), and so on. These values were calculated directly for the alternating 
permutations in j5], Section 2. 

Corollary 4.3. For all n >0,k>2, a 2n+ i(132, 341256 • •■ (fc+2)) = s„(132, 2134 ■ ■ • k). 

Proof. We have <p(2134 ■ ■ ■ k) = (k+2)(k+3)k(k+l){k-l){k+A)(k-2)(k+5) ■ ■ -2(2k+ 
1)1. This contains the subsequence (k + 2) (k + 3) k{k + 1) (k + 4) (fc + 5) • • • (2k) {2k + 1) , 
an instance of the pattern q = 341256 ••• (k + 2). This q contains the subsequence 
(k + 3)(k + l)(k + A)(k + 5) • • • (2k)(2k + 1), an instance of 2134 ---k containing no 
left-to-right minima of q. Then the result follows. □ 

The resulting sequences are the same as in the previous case (see 0E]). 

Note that in both Corollaries 14.21 and 14.31 we chose the shortest possible pattern q 
associated with p = 123 ■ • • k or p — 213 • • • k, respectively. In both cases there are 
many other possible choices for q of various lengths: we could take any q' that is order- 
isomorphic to a subsequence of (p(p) that contains our selected instance of q. In our 
last example, the choice of q is much more restricted: 

Corollary 4.4. For all n> 0, k >2, a 2n+1 (132, (2/c-l)(2/v)(2/c-3)(2/>-2) ■ ■ -3412) = 
s n (132,Jfc(Jfc-l)...21). 



Proof. We have <p(k(k - 1) • • - 21) = (2k)(2k + l)(2k - 2)(2k - 1) • • -45231, and taking 
q to be the permutation order-isomorphic to tp(p) with the final 1 removed gives the 
result. □ 
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For k = 2 the resulting sequence is a 2 „+i(132, 3412) = s n (132, 21) = 1 and for k = 3 
it's a 2n+1 (132, 563412) = s„(132, 321) = " 2 -"+ 2 (see [7]). The q selected in this instance 
is the only possible choice other than q' = f(p). 

5. A COMMENT ON EVEN-LENGTH PERMUTATIONS 

Our preceding results all concern alternating permutations of odd length. However, 
there is a simple relationship between 132-avoiding alternating permutations of length 
2n + 1 and 132-avoiding alternating permutations of length 2n. By the observation 
at the beginning of the proof of Proposition 13.21 if w G 74 2n+ i(132) then tw 2n +i = 1- 
Thus, from any 132-avoiding alternating permutation w of length 2n + 1 we can build 
a 132-avoiding alternating permutation w' of length 2n by removing the last entry of 
w and subtracting 1 from each other entry, i.e. w' = (wi — l)(w 2 — 1) • • • (w 2n — 1). 
Conversely, given any 132-avoiding alternating permutation w' of length 2n we can build 
a 132-avoiding alternating permutation w of length 2n + 1 by adding 1 to each entry 
and appending a 1, i.e. w = (w[ + l)(w' 2 + 1) • • • {w' 2n + 1)1. It follows immediately that 
a 2n (132) = a 2n+ i(132). Moreover, w G J 4 2n+1 (132) avoids a pattern p = p x - ■ -pk-iPk 
with p k = 1 if and only if w' avoids p' = (p% — 1) • • • (pk-i — 1), while if p k ^ 1 
then w avoids p if and only if w' avoids p. Then if p\ , . . . , pi are patterns ending in 1 
and q%, . . . , qj are patterns not ending in 1 we have a 2n+ i(132,p 1 , . . . ,p i ,q 1 , . . . , qj) = 
a 2n (132,p' 1 , . . . ,p' { ,qi, . . . , qj), so in particular every enumeration problem concerning 
132-avoiding alternating permutations of even length reduces to a problem concerning 
permutations of odd length. 
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